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On  the  Capital  Budgeting  of  Interrelated  Projects 

H.  Martin  Weingartner 
Sloan  School  of  Management,  M.I.T. 

I.   INTRODUCTION 

The  literature  on  capital  budgeting  generally  confines  itself  at  best 
to  a  few  of  the  relevant  aspects  of  the  investment  decision  problem,  omitting 
certain  others  which  are  nonetheless  essential  ingredients  of  the  problem 
which  managers  of  firms  must  solve.  Most,  though  by  no  means  all,  discussions 
of  formal  decision  models  as8\jme  certainty.  Further,  they  make  either  of  two 
extreme  assumptions :  that  a  meaningful  investment  demand  schedule  already 
exists,  as  in  the  manner  of  Fisher's  transformation  function,   or  that  all 
investment  alternatives  are  independent  in  the  sense  that  the  acceptance  of 
any  set  of  them  does  not  affect  the  feasibility  or  profitability  of  accepting 
any  different  set.  With  some  notable  exceptions  [19,  l6,  29  and  28]  the  litera- 
ture also  disregards  the  case  of  capital  rationing,  usually  on  the  ground  that 
rationing  ought  not  to  exist  when  firms  behave  rationally  (in  the  narrow  economic 
sense).  A  more  cogent  basis  for  reticence,  although  seldom  expressed,  is  that 
the  appropriate  criterion  for  the  choice  of  Investments  under  rationing  has  not 
been  agreed  upon.  Nevertheless,  project  selections  are  being  made  all  the  time, 
even  without  all  the  theoretical  niceties  having  been  resolved,  although  the 
need  for  such  work  is  recognized. 

The  present  paper  is  designed  to  survey  the  techniques  available  to 
the  practitioner  who  must  decide  on  an  investment  program  consisting  of  a  poten- 


SeeLlOj.  Fisher  called  it  the  "Opportiinlty  Line."  This  is  not  the  same  as 
Keynes'  Marginal  Efficiency  of  Capital  Schedule  [I7j  or  Dean's  Investment  demand 
schedule  in[7l. 
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tially  large  number  of  interrelated  projects,  possibly  also  subject  to  constraints 
on  capital  or  other  resources,  and  who  is  willing  to  utilize  the  framework  of 
certainty  for  making  part  of  his  analysis  or  who  can  adapt  his  problem  to  fit 
within  the  capabilities  of  relatively  simple  methods  for  dealing  with  random 
events.  The  basic  outlook  behind  such  a  presentation  would  include  the  follow- 
ing points.  First,  short- nin  limitations  on  the  availability  of  resources  are 

a  common  experience.  These  may  not  be  in  the  form  of  capital  shortages,  but 

2 
rather  on  critical  manpower  or  other  inputs  which  have  to  be  accepted  by  the 

decision-maker.  Second,  although  the  theory  of  investment  under  uncertainty  is 
not  yet  in  an  advanced  state  of  development,   some  progress  has  been  made  in  pro- 
viding aids  to  the  decision-maker.  Mathematical  models  are  being  developed  by 
means  of  which  the  consequences  of  a  series  of  complex  assumptions  can  be  followed 
to  their  conclusions,  and  optimization  of  specified  objectives  may  be  achieved. 
Directly  related  is  the  availability  of  efficient  computational  methods,  usually 
employing  computers,  which  enhances  or  even  makes  possible  the  application  of 
formal  methods.  This  combination  of  analysis  and  automatic  calculation  can  then 
be  utilized  to  obtain  a  "generalized  sensitivity  analysis"  for  the  essential 
parameters  of  the  problems.  Thus  a  variety  of  intricate  and  sophisticated  con- 
siderations can  be  brought  to  bear  on  capital  budgeting  decisions  in  such  a  way, 
that  the  talents  and  energies  of  management  may  be  devoted  to  those  aspects  of 
the  problem  which  may  benefit  most  from  informed  and  experienced  judgement — the 
data  inputs . 


^See[29j  Sec.  7.2  and  7. 5' 

•^Witness  the  problem  of  intertemporal  comparisons  and  aggregation  of  utilities, 
which  is  reflected  in  part  in  the  determination  of  the  appropriate  rate  for  dis- 
counting. 
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II.   THE  LORIE- SAVAGE  PROBLEM 
A.  Integer  Programming 

A  now  familiar  problem,  first  discussed  by  J.  H.  Lorie  and  L.  J.  Savage 
in  1955  [19]  inay  serve  as  the  point  of  departure  for  our  discussion.  Given  the 
net  present  value  of  a  set  of  independent  investment  alternatives,  and  given  the 
required  outlays  for  the  projects  in  each  of  two  time  periods,  find  the  subset 
of  projects  which  maximizes  the  total  net  present  value  of  the  accepted  ones 
while  simultaneously  satisfying  a  constraint  on  the  outlays  in  each  of  the  two 
periods.  The  problem  may  be  generalized  to  an  arbitrary  number  of  time  periods 
and  stated  formally  as  an  integer  programming  problem,  using  the  following  nota- 
tion. Let  b.  be  the  net  present  value  of  project  j,  when  discounting  is  done  by 
J 

the  appropriate  rate  of  Interest;  let  c  .  be  the  outlay  required  for  the  j 
project  in  the  t   period;  let  C.  be  the  maximxan  permissible  expenditure  in 
period  t.  We  define  x.   to  be  the  fraction  of  project  j^  accepted,  and  require 
that  x^  he  either  zero  or  one.  The  model  may  then  be  written  as. 


n 
a)     Maximize   )  b. 


"j 


n 


b)  Subject  to  ^  c.  .  x^  C.,       t  =  1,  ...,  T 
II.l  j^^ 

c)  0  <  Xj<  1,       J  =  1> 


•  •  ■  u. 


d)  X.  integral. 


This  is  usixally  referred  to  as  the  cost  of  capital. 


k 

Solution  of  this  problem  depends  only  upon  finding  a  good  integer  pro- 
gramming code.  Given  that  the  c. ,  are  nonnegative  the  problem  is  bounded,  and  a 
finite  optimum  exists.   However,  integer  programming  algorithms  still  perform 
unpredictably  and  so  it  may  be  useful  to  mention  alternative  methods  which  will 
also  be  relevant  for  our  later  discussion.  Before  doing  so  it  shoxild  be  pointed 
out  that  the  budgets  expressed  in  constraints  II. lb  may  refer  to  resources  which 
are  limited  in  supply  in  the  short  rvm,  in  addition  or  alternative  to  constraints 
on  capital  expenditures.  An  example  might  be  drawn  from  a  firm  such  as  Sears, 
Roebuck  and  Company  when  it  is  planning  a  sharp  increase  in  the  number  of  stores. 
A  limit  on  its  expansion  could  come  about  from  the  availability  of  managers  for 
the  new  stores,  a  number  that  cannot  be  increased  simply  by  bidding  managers 
away  from  competitors  and  immediately  putting  them  in  charge  of  Sears  stores. 
A  period  of  time  is  required  for  the  new  personnel  to  learn  the  ways  of  the  or- 
ganization, to  make  effective  communication  and  execution  of  management  policies 
possible.  Such  an  Interpretation  of  budgets  probably  carries  more  realism  than 
the  model  of  capital  rationing  implied  by  the  original  Lorie-Savage  formulation 

[29,  pp.  126-27].   1 

A  related  point  requires  some  amplification  here.  The  example  above 
suggests  models  in  which  the  constraints  also  express  generation  or  release  of 
resources  through  the  adoption  of  new  projects.  Thus  a  store  might  also  produce 
future  managers  by  training  assistant  managers  for  that  duty.  Basically  the 
only  change  required  in  the  formal  model  II. 1  would  be  to  allow  the  coefficients 
G  .  to  be  negative  as  well  as  nonnegative.  However,  such  changes  require 


^See  [29]  Chap.  k. 
6 


See  [22];  also  the  author's  escperience  with  an  All- Integer  code,  IPM3,  was  that 
a  problem  of  this  type  with  three  constraints  II. lb  and  10  projects  failed  to 
converge  within  5000  iterations.   See  also  [12]. 
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some  more  fundamental  relnterpretations  of  the  explicitly  dynamic  character  of 
the  process  being  modelled,  and  this  falls  outside  the  sphere  of  interest  here. 
In  additioni  these  problems  have  been  treated  at  length  in  [29]  Chapters  8  and  9« 
B.  The  Linear  Programming  Solution 

The  Lorie- Savage  problem  may  also  be  regarded  as  a  simple  linear 

programming  problem  by  dropping  the  requirement  II. Id  that  the  x.  be  integers. 

"~* 
The  major  consequence  from  this  change  here  is  that  some  of  the  x^^  the  values 

of  X,  in  the  optimal  solution,  may  turn  out  to  be  proper  fractions.  Fortunately 
A 

it  is  possible  to  prove  that  there  is  an  upper  limit  on  the  number  of  fractional 

7 
projects  given  by  T,  the  number  of  periods  for  which  budget  constraints  exist. 

The  difficulties  in  the  use  and  interpretation  of  the  linear  programming  solu- 
tions may  be  summarized  by  citing  the  following  points.  First,  the  pirojects 
may  not,  in  fact,  be  completely  fixed  in  scale,  or  the  budgets,  designed  primarily 
for  control  purposes,  do  permit  a  degree  of  flexibility.  On  the  other  hand,  some 
projects  are  essentially  discrete,  as  in  location  problems,  and  also  the  budgeted 
inputs  may  be  rigidly  limited.  In  addition,  the  maximum  number  of  fractional  pro- 
jects increases  when  interrelationships  between  projects  must  aslo  be  taken  into 
account.  Our  concern  in  this  paper  is  exclusively  with  the  problem  involving 
discrete  projects,  and  hence  we  shall  put  aside  the  linear  programming  solution. 

Before  going  on  to  alternative  approaches,  however,  it  should  be  pointed 
out  that  Lorie  and  Savage  proposed  a  trial  and  error  method  for  finding  the  inte- 
ger solution.  When  analyzed  in  the  framework  of  mathematical  programming  it  may 
be  seen  that  they  sought  to  solve  the  integer  programming  problem  by  finding  (by 
trial  and  error)  the  optimal  dual  variables  for  the  budget  constraints  of  a 
linear  programming  formulation.  Itofortunately,  the 


Proof  of  this  and  related  propositions  are  given  in  [29]  Sec.  3.8. 
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desired  quantities  do  not  always  exist,  and  their  cumbersome  technique,  which 
is  barely  manageable  in  the  two- constraint  case,  fails  to  give  any  indication 
when  the  quest  Is  in  vain  and  should  be  abandonedt  However,  these  difficulties 

o 

are  fully  discussed  in  [29]  and  need  not  detain  us  here. 
C.  Dynamic  Programming 

The  problem  as  formulated  in  equations  II. 1  may  be  recognized  as  a 
special  case  of  the  knapsack  or  flyaway  kit  problem  [6,  h,   pp.  U2-'4-7]  when  the 
number  of  "budget"  constraints  is  smaJLL.  It  arises,  for  example,  when  a  camper 
must  choose  the  number  of  each  of  n  items  he  wishes  to  carry  in  his  knapsack  when 

the  utility  to  him  of  each  is  given,  and  total  volume  and  weight  limitations  are 

9 
imposed  by  the  size  of  the  knapsack.   It  may  also  be  interpreted  as  the  number 

of  spare  parts  to  be  taken  eilong  by  a  submarine  for  which  similar  limitations 

on  weight  and  volume  exist,  but  for  which  the  benefit  of  the  spare-parts  kit 

involves  the  pI^^bability  that  a  part  is  needed  and  the  cost  of  being  without  it. 

Leaving  stochastic  aspects  for  a  later  section  of  this  paper,  we  may  write  down 

the  dynamic  programming  formulation  of  this  general  problem  and  briefly  discuss 

some  shortcuts  for  the  Lorie-Savage  problem. 

As  in  the  dynamic  programming  solution  to  the  knapsack  problem,  the 

time  sequence  is  replaced  by  the  sequence  of  projects  being  considered,  and  the 

ordering  of  the  projects  is  arbitrary.    The  method  consists  of  determining 

the  list  of  projects  which  woxild  be  accepted  if  the  "budgets"  in  the  T  periods  were 

C, ,  £ri>  "-tCrn}   ^^d  selection  were  restricted  to  the  first  J.  projects.  This  is 


— 

The  difficulties  involve  the  dxials  to  integer  programming  problems,  see  [29] 
Chap.  2,  and  Sections  3.5,  k.2,   and  5.8. 

Q 

This  differs  from  the  problem  stated  in  II. 1  in  that  constraints  II. Ic  are  omitted. 
Some  preliminary  screening  and  rearranging  may  help  to  cut  computation  time. 
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done  f or  1=1, . . . , n,  and  within  each  "stage"  i,  for  all  feasible  vectors, 

tilt  t 

C  =  (C,,  C»,  ...,C„),  where  feasibility  means  that  0  <  C .  <  C.,   t=l,  ...,T. 

I    T       I  -*    - 

We  define  ^j(C,>  Cp>...>C_)  as  the  total  value  associated  with  an  optimal  choice 
among  the  first  1  projects  when  funds  employed  are  as  defined.  The  basic  re- 
currence relationship  then  may  be  stated  as 

III  It  t 

t^(C^,C^,».»,C^)  =       max       [b^x^  +  ^^_2.^C^  '  °li  V  ^2  '   ^2iV*"'^T  "   ^Tl\^^ 

II. 2  PS^lS*-  ^  ~  1,  ...,n 

f 
for  C^  -  c^^  >  0,   t  =  1, . .  .,T 

and  f     (C  )  =  0 

o 

where  f . (C  )  is  the  total  value  of  the  optimally  selected  projects  with  projects 

_i  +  1,  j.  +  2,  ...,n  still  to  be  considered  and  the  unallocated  funds  are  given  by  C  . 

Two  departures  from  the  usual  dynamic  programming  version  of  the  knap- 
sack problem  may  be  noted.  First,  the  number  of  "budget"  constraints  is  an  arbi- 
trary number  T,  which  may  be  significantly  greater  than  two.  Also,  the  x^  are 
either  zero  or  one  here,  whereas  in  the  knapsack  problem  they  may  be  any  integers 
usually  up  to  some  upper  limit  on  each  item.  Dantzig  regards  even  two  budgets 
for  the  knapsack  problem  to  be  one  too  many,   and  Bellman  [3]  suggests  that  a 

second  constraint  be  handled  by  use  of  a  Lagrangian  mviltlplier  by  maximizing 

n  n 


II.3  ^Vl   -    ^I  =21^1 

1=1  1=1 

subject  to  the  single  constraint 

n 
II.  1.  ^  c^.x^  <  C^. 

1=1 


"It  [the  dynamic  programming  approach  to  the  knapsack  problem]  Is  recommended 
where  there  are  only  a  few  Items  and  only  one  kind  of  limitation."  [6]  p.  275* 
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A  value  of  X  is  assumed  and  the  one- dimensional  recurrence  relation 

II. 5  f^CCj^)  "  max  [  (b^  -  ^2i^\  "^  ^i-l^^l^li^l'^'^ 

0<x^<l 
is  solved  as  before.  Bellman  comments,  "The  value  of  \  is  varied  until  the  second 
constraint  is  satisfied.  In  practice,  only  a  few  tries  are  required  to  obtain  the 
solution  in  this  manner."  [3,  p.T2l4-]  Of  course,  there  is  no  guarantee  that  the  sec- 
ond (or  first)  constraint  will  be  satisfied  exactly.  Thus,  depending  on  the  numeri- 
cal values  of  the  i)arameters,  the  search  for  the  optimal  X  may  not  be  quite  as 

12 
short  as  a  "few  tries."    Certainly,  one  would  not  want  to  resort  to  two  Lagrangian 

multipliers  to  handle  three  kinds  of  limitations.  The  difficulties  with  such  a  pro- 
cedure have  already  been  referred  to  in  connection  with  the  Lorie- Savage  solution 
to  this  problem.  -^ 

Joel  Cord,  in  an  article  in  Management  Science  [5],  utilizes  dynamic  pro- 
gramming for  project  selection  in  Just  the  way  Bellman  suggests,  although  Cord's 
constraints  are  on  total  outlay  and  average  variance  or  return.  We  shall  return 
to  the  substance  of  Cord's  article  below.  For  the  moment,  we  merely  wish  to  point 
out  that  the  zero-one  limitation  on  the  unknowns  makes  it  possible  to  handle  both 

constraints  efficiently  without  recourse  to  Lagrangian  multipliers,  and  that  even 

14 
more  can  be  handled  when  the  number  of  projects  to  be  considered  is  not  loo  large. 

The  computer  program  flow- charted  in  Appendix  A  makes  use  of  this  property,  and  by 

careful  housekeeping   is  able  to  handle  a  reasonable  number  of  constraints. 
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In  part,  this  depends  on  what  one  regards  as  "few." 

■^See  footnote  8. 

What  constitutes  a  reasonable  number  of  projects  has  not  been  determined,  al- 
though computational  problems  for  capital  budgeting  applications  are  apt  not 
to  be  limiting.  More  significantly,  the  use  of  Lagrangian  multipliers  has  led 
Cord  to  overlook  the  optimum  solution  in  his  numerical  problem  [5,   p.  S'*-!]*  The 
actual  optimum  consists  of  projects  5,8,12,13  and  20.   Cord's  erroneous  solu- 
tion appears  to  stem  from  his  use  of  a  fixed  search  Interval  for  the  Lagrangian 
multiplier.  Other  computational  aspects  are  discussed  in  Appendix  A. 

^E.g.,  by  making  use  of  lexicographically  ordered  vectors. 
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III.   INTERDEPENDENT  PROJECTS  WITHOUT  BUDGET  CONSTRAINTS 

Difficulties  vith  the  usual  "text-book"  methods  of  capital  expenditure 
evaluation,  e.gi,  internal  rate  of  return  or  present  value,  arise  when  the  indepen- 
dence assumption  between  projects  does  not  hold.  How  strong  this  assvanption  is 
may  be  seen  when  one  considers  that  alternative  to  almost  every  project  is  the  pos- 
sibility of  its  postponement  for  one  or  more  periods,  with  concomitant  changes  in 
outlays  and  payoffs.  These,  of  course,  form  a  mutually-exclusive  set  of  alterna- 
tives since  it  would  be  deemed  uneconomical,  if  not  impossible,  to  carry  out  more 
than  one  of  them.   Mutual  exclusion  is  by  no  means  the  only  alternative  to  inde- 
pendence, even  though  this  is  the  only  other  possibility  which  is  usually  raised  in 
the  literature.  Contingent  or  dependent  projects  can  arise,  for  instance,  when  "ac- 
ceptance of  one  proposal  is  dependent  on  acceptance  of  one  or  more  other  proposals  " 
[29,p.ll]« One  simple  example  would  be  the  purchase  of  an  extra- long  boom  for  a  crane 
which  would  be  of  little  value  unless  the  crane  itself  were  also  purchased;  the  lat- 
ter, however,  may  be  Justified  on  its  own.  When  contingent  projects  are  combined 
with  their  independent  "prerequisites"  we  may  call  the  combination  a  "compound  pro- 
ject." Thus  a  compound  project  is  characterised  by  the  algebraic  sum  of  the  pay- 
offs and  costs  of  the  component  projects.  It  is  of  course  true  that  in  principle 
all  contingent  projects  can  be  represented  by  sets  of  mutually- exclusive  compound 
projects.  In  practice,  however,  this  is  likely  to  prove  an  undesirable  way  of 
handling  them,  for  the  nvraiber  of  compound  projects  may  be  very  large.  In  the  pres- 
ent section  of  this  paper  we  shall  take  up  the  treatment  of  interdependent  projects 
in  the  context  of  the  models  discussed  in  the  previous  section.  We  shall  also 

take  up  an  alternative  formulation  which  allows  a  wider  variety  of  interrelation- 

17 

ships,  omitting,  for  the  present,  consideration  of  budget  constiraints. 

See,  for  example,  Marglin's  analysis  of  the  "Myopia  Rule"  in  [20]. 

17 

In  this  paper  we  omit  consideration  of  interdependence  between  existing  projects 

and  new  ones.  Models  which  deal  with  such  problems  will,   be  of  the  type  referred  to 

at  the  end  of  Sec.IIA,  although  the  tools  developed  here  will  still  be  applicable. 
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A.  Linear  and  Integer  Programming 

The  methods  of  handling  interrelationships  of  the  types  mentioned  in 

the  paragraph  above  were  discussed  at  length  elsewhere,  and  hence  a  brief  summary 

18 
here  will  suffice. 

Consider  a  set  J  of  mutuaOJ^-exclusive  projects  from  which  at  most 

one  is  to  be  selected.  This  constraint  may  be  expressed  by 


I 


iii.i  ;  X  <  1. 

J£J 

With  the  Implied  nonnegativlty  constraint  on  the  X-*  this  has  the  effect  of 

A 

limiting  the  stjm  of  projects  accepted  from  the  set  J  to  a  single  one.  When  an 

integer  programming  algorithm  is  utilized  to  solve  the  problem  one  is  assured 

that  at  most  one  of  the  x^  equals  unity,  j€j,  while  the  remainder  from  the  set 

A.  — — 

are  zero.  Solution  by  linear  programming  leads  to  the  possibility  that  several 

projects  from  the  set  J  will  be  fractionally  accepted.  The  total  number  of  such 

* 
projects  will  still  be  limited  although  a  situation  with  fractional  x.  for  more 

A 

19 
than  one  project  in  the  set  J  can  arise.    Note  that  the  unity  upper  bound  con- 
straint on  the  X.  individiially,  JS J,  are  now  superfluous. 
-J  

Contingent  projects  may  be  handled  in  a  similarly  simple  manner.  If 
project  _r  may  be  undertaken  only  if  project  _s  is  accepted,  but  project  _8  is  an 
independent  alternative,  then  we  may  express  the  relationship  by 

III. 2  a)    X  <  x„ 

'     r  —  B 

and  b)    x„  <  1. 

'        8  — 
■)(■ 

Thus,  if  X  e  1,  i.e.,  it  is  accepted  in  the  optimal  solution,  then  x  <  1  is  the 
effective  constraint.  Otherwise,  x  <  0,  together  with  the  nonnegativity  require- 


See  [29]  pp. 10-11,  32-U3,  and  the  analysis  of  the  duals  to  these  constraints, 
pp.  147-52. 

See  [29]  p. 37.  For  an  interpretation  of  this  result,  see  also  [29]p«  32. 
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ment,  forces  x  -   0.  If  projects  u  and  v  are  mutually-exclusive  eiltematives, 
and  project  r  is  dependent  on  acceptance  of  either  project  u  or  project  v,  this 
interrelationship  may  be  expressed  by 

a)  X  +  X  <  1 

u    v  — 

III.3 

b)  X  <  X  +  X 

'      r  —  u    V 

Hence,  if  one  of  the  pair,  u  and  v  is  accepted,  then  constraint  III. 3b  becomes 
X  <  1.  If  neither  u  nor  v  is  accepted,  then  III. 3b  becomes  x  <  0,  implying, 
once  again,  that  x  ■»  0.  Similarly,  if  projects  r  and  _8  are  mutvially-exclusive 
and  dependant  on  the  acceptance  of  either  project  u  or  v,  two  mutually- exclusive 
alternatives,  the  interdependence  may  be  represented  by  the  two  constraints 

III.l^ 


a)     X  +  X  <  1 

'      u    V  — 


b)     x+x<x+x. 

'     r    s  —  u    V 

Contingent  chains  can  easily  be  built  up,  as  when  acceptance  of  project  r   Is 
dependent  on  acceptance'  of  project  _s,  which  in  turn  is  dependent  on  acceptance 
of  project  u: 


III.  5 


a) 

X     <  1 
u  — 

b) 

^s:5\i 

c) 

^r  ^  ^s' 

etc. 

B.  Dynamic  Programming 

A  glance  at  Inequality  III.l  which  states  the  restriction  on  mutually- 
exculslve  projects  reveals  that  its  algebraic  form  is  exactly  that  of  the  budget 
constraints,  restrictions  II. lb,  i.e.,  the  coefficients  are  all  nonnegatlve.  This 
was  the  only  requirement  necessary  for  applying  the  knapsack  problem  formulation. 
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and  hence  solution  by  dynamic  programming  hinges  only  on  the  computational  prob- 
lem derived  from  having  additional  constraints.  Since  at  most  a  few  of  the  projects 
vd.ll  be  mutually- exclusive  at  one  time,  although  there  may  be  many  such  sets,  the 

number  of  nonzero  coefficients  will  be  small.  This  has  the  effect  of  speeding  up 

of 
the  calculations  and  keeping  the  "in- lists" — the  lists/accepted  projects — relatively 

small. 

In  principle,  contingent  projects  can  be  handled  as  sets  of  mutually- 
exclusive  compound  alternatives,  as  was  pointed  out  above.  The  difficulty  with 
the  dependency  relation  III. 2a  may  be  seen  by  putting  both  unknowns  on  the  same 
side  of  the  inequality,  as  in 

111. 6  x^  -  x„  <  0. 

The  zero  right  side  presents  no  diffic\ilty.  However,  the  negative  coefficient 

^        -N- 

of  X  does.  A  solution  with  x  =  1,  x  «=  0  would  be  feasible;  yet,  in  the 
dynamic  programming  calculation,  the  unallocated  amounts  for  each  of  the  budgets 
must  be  nonnegative.  The  algorithm  tests  for  this  condition  at  each  step. 
A  way  out  of  the  difficulty  is  to  multiply  the  constraint  by  -1: 

111. 7  x„  -  X  >  0. 

B    r  — 

In  this  form  the  feasibility  test  of  the  dynamic  programming  calculation  is 
satisfied  only  when  the  dependency  condition  is  satisfied  as  intended.  In 

■it  -K- 

addition,  x  =  1,  x  «=  0  is  also  feasible  in  both  senses.  To  make  the  constraint 
'  — 8    '  — r 

have  the  proper  foim  we  also  put  on  the  "budget"  of  unity, 

111. 8  0  <  X  -  X  <  1 

—  s    r  — 

and  add  the  additional  "feasibility  test"  for  this  (say  the  k  )  budget. 


III.9  C^.  ^Cj^iX^fl. 


:i3 


The  more  complex  interrelationship  given  by  restrictions  Ill.^m  and  b  can  also 
be  represented  by  the  constraints, 


III. 10 


a)  0<x+x-x-x<l 

'  —     u        V         r         s  — 


b)  X    +  X    <  1, 

'  u         V  —     ' 


with  the  additional  feasibility  test  111.9.''"^^ 

C.  Quadratic  Integer  Programming  and  the  Generalization  of  Second- order  Effects 
Althoxogh  contrary  to  the  teaching  of  the  principle  of  "Occam's  Razor," 
it  is  possible  to  represent  the  above  interdependencies  by  means  of  quadratic 
constraints  superimposed  on  the  O/l  integer  requirement  for  the  x^ •  For  two 
mutually- exclusive  projects,  r  and  b,   the  relevant  restriction,  in  addition  to 
none  gat  ivity  on  the  vinknowns,  woxild  be 

111. 11  X  .X  <  0 

r  8  — 

'K'  #  it  'X- 

which  makes  either  x  =  1  or  x  =1,  but  not  both  x  =  1  and  x  =  1.  For  the 
dependence  of  project  _r  on  project  _s,  we  require 

111.12  X  (l-x  )  <  0. 

r    s'  — 

■N-        'N' 

Thus,  if  x  =  1,  X  may  be  either  zero  or  one  and  the  restriction  will  be  satis- 
fied.  However,  if  x  =0  then  x  «  0  necessarily. 

A  generalization  to  include  all  pair-wise  of  second-order  effects  has 
been  offered  by  S.  Reiter  [2k].    A  triangular  payoff  matrix 


19a 

The  method  actually  employed  in  a  number  of  numeirical  problems,  and  which  made 

use  of  some  special  features  of  the  program,  required  only  that  projects  be  pre- 
ordered  so  that  the  independent  members  of  a  set  al.ways  preceded  the  de- 
pendent ones.  Such  sequencing  obviated  use  of  a  second  constraint  for  any 
given  dependence  relation* 
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III. 13 


B 


12 
0 


13 
'23 
'33 


In 


2n 


3n 


nn 

is  defined  for  the  set  of  n  investment  alternatives  such  that  the  payoff  (e.g., 
net  present  value)  from  the  acceptance  of  project  _r  alone  is  b  ,  and  the  addi- 
tional payoff  from  acceptance  of  both  projects  r  and  £  is  b  ,  apart  from  the 

payoff  from  acceptance  of  project  r,  b  ,  and  project  s,  b  .  An  optimal  parti- 

—  — rr  ~"  — ss 

tioning  of  the  set  of  project  indices,  J.«=l,  ...,m  into  two  mutually- exclusive  and 
exhaustive  subsets,  )i-|>...;J;  (  and  its  complement  is  sought  such  that  the  total 
payoff  from  the  first  subset,  the  "in- list, "  is  maximum.  Given  any  such  parti- 
tioning the  payoff  P    associated  with  an  in- list  a  may  be  thought  of  being  obtained 
by  crossing  out  all  rows  and  columns  of  B  which  are  not  on  the  in- list  and  adding 
up  the  b  .  that  remain.  In  Reiter's  context  such  a  payoff  matrix  represents  as 

optmization  problem  only  if  some  b. .  are  negative,  for  otherwise  the  optimal 

* 
in  list  a  would  be  the  entire  list  of  projects.  However,  in  some  of  our  exten- 

tions,  below,  this  need  not  be  the  case.  It  is  also  clear  that  the  elements 

below  the  diagonal  are  not  needed  to  represent  any  of  the  interaction  effects 

which  can  be  handled  in  an  n  x  n  array. 

A  few  examples  paralleling  our  earlier  discussion  will  bring  out  some 

of  the  features  of  this  development.   If  projects  r  and  _s  are  mutually- exclusive, 

all  that  is  necessary  to  prevent  their  simultaneous  adoption  is  to  make  b   a 


highly  negative  penalty 


20 


Of  course,  all  that  is  required  here  is  the  value 


20 


This  is  analogous  to  the  penalty  for  keeping  artificial  vectors  out  of  the  opti- 
mal basis  of  a  linear  programming  solution.  See  [Ub]  Section  l.k. 
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]d   which  makes  the  totsil  b   +  h      +  b   represent  the  net  value  of  adopting 


-rs 


-rr 


rs 


both  alternatives,  a  qviantity  which  will  certainly  be  smaller  than  either  b   or 
b  ,  the  value  of  either  alternative  alone.  Hence,  b   will  be  negative.  Using 
the  penalty  of  -M  we  may  represent  a  set  of  mutually-exclusive  projects,  for  pur- 
poses of  illustration  assigned  to  be  the  first  k  projects,  by 
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B 


^11 

-M       -M       . . 

.        -M 

0 

b22     -M        .. 

.        -M 

0 

0      b33     .. 

•  •  •                         •  • 

-M 

0 

0         0.. 

.       b,., 

kk 


A  dependence  of  project  _r  on  project  _s  is  handled  by  letting  b   be  the  cost, 

a  negative  quantity  while  b   represents  the  benefit  from  having  r  in  addition  to 

^rs  ■" 

s.  b   would  be  the  net  payoff  from  accepting  project  s  alone.  We  may  finally 
illustrate  this  formulation  with  the  situation  expressed  by  equations  111.4a  and  b, 
in  which  projects  u  and  v  are  mutually- exclusive,  as  are  projects  _r  and  _b,  and 
in  addition  to  which  acceptance  of  project  _r  or  _s  is  dependent  on  acceptance  of 
project  u  or  V. 
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B 


\ 

-M 

^ru 

b 
rv 

0 

'\ 

^u 

^v 

0 

0 

b 
uu 

-M 

0 

0 

0 

b 

w 

Here  the  qiiantities  -b     and  -b     represent  the  cost  of  projects  r  and  s,    respec- 

"~r     ^s  ■"    "^ 

tively;  b   and  b   represent  the  net  benefit  from  doing  project  u  or  v  alone; 
and  b  ,  b  ,  ^_-^  J°       represent  the  additional  benefits  from  selecting  both  pro- 
jects r  and  u,  b   and  u,  r  and  v,  and  e   and  v,  respectively.  Once  again  the  quan- 
tity -M  is  a  large  and  negative  penalty,  intended  to  dominate  its  row  and  column 
by  a  substantial  amount. 
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Before  presenting  an  outline  of  Reiter'a  method  for  finding  the  opti- 
mal partitioning  of  the  project  Indices,  we  may  show  that  his  problem  is  actually 

an  integer  quadratic  programming  problem: 

n         n   n 

III.  16  Maximize     XBX*  =  y  b^^x^  "*"  /   /  \l^i^1 

1=1        1=1  j=l 

where  X  =  (x,,  x^,,..,x  ),  ^   is  its  transpose,  and  x.  =  0  or  1.  Thus  the  pay- 

~         *         *  ~ 

off  b. .  is  realized  only  if  both  x.  =  1  and  x^  =  1»  Otherwise  the  product 

*~*  ~         ~ 

b. jX.Xj  =  0«  Similarly,  since  the  x.  are  restricted  to  zero  and  unity  It  is 
^J~^  J.  i 

2 
unnecessary  to  distingiilsh  between  x^  and  x. .  We  shall  return  to  other  problems 

in  which  this  formulation  is  of  utility  later  on. 

Reiter's  method  for  maximizing  III.16  is  not  algorithmic  in  the  usual 
sense.  It  locates  a  local  maximum  (gioaranteed  to  exist  by  the  flnlteness  of  the 
number  of  projects)  by  a  gradient  method  that  traverses  "connected  In- lists," 
E^  starting  at  random  in- lists  it  generates  a  vB,rlety  of  local  optima  which  can 
be  arranged  In  ascending  order.  Whether  the  global  optimum  is  reached  depends 
on  whether  an  initial  in- list  is  selected  which  leads  to  the  global  optimum  as 
its  local  optimum.  Hence,  it  is  possible  to  estimate  probabilistically  the  chances 
that  the  global  optimum  will  be  reached.  Optimal  stopping  rules  (based  on  the 
value  of  improvement  vs.  the  computational  cost  of  obtaining  it)  and  optimal 
fixed  san^jle-size  plans  have  also  been  developed  [25  and  26]* 

The  method  may  be  described  as  follows.  Given  an  arbitrary  in-list 

from  a  either  by  including  one  project  not  contained  in  a,  or  by  excluding  one 
project  which  is  included  in  Of.  The  quantity  '   is  computed  for  each  a  connec- 


a,  compute  the  corresponding  payoff  I  .  A  connected  in-list  oc     is  one  which  differs 


IT 
ted  to  a,  and  so  is  the  gradient  Ov ,  »  fV,  -  PLt  The  a'  corresponding  to  the 
largest  G^,  is  selected  as  the  starting  point  for  the  next  iteration  and  these 
are  continued  until  no  a'  can  be  found  for  which  G^,>  0.  Once  this  point  has 
been  reached  the  in- list  vith  a  local  maximum  has  been  fo\md.   (in  the  event  of 
ties  between  G^,  along  the  way,  a  simple  rule  such  as  choosing  that  a'  with  the 
smallest  first  index  [where  a  difference  exists]  can  be  used  to  break  the  tie.  ) 

Having  found  a  local  optimum  one  seeks  to  choose  a  new  starting  in- list 
which  has  not  already  been  evaluated,  so  as  to  find  another  local  optimum.  The 
connected  in- lists  constitute  branches  on  a  tree  which  has  many  starting  points 
that  lead  to  the  top  (the  local  maximum).  The  "broader"  the  tree  having  the 
global  optimum  as  its  local  maximum,  the  mbre  likely  it  is  that  the  global  opti- 
mum will  be  found.  The  method  guarantees  only  that  the  global  maximum  will  be 
found  with  "probability  one."  Unfortunately,  it  will  not  be  recognized  as  such 
short  of  evaluating  every  possible  in- list  along  the  way.  However,  by  careful 

use  of  prior  information  [26]  and  aspiration  levels  to  Indicate  when  the  proce- 

21 
dure  should  be  stopped,  one  can  arrive  at  "good"  programs  rapidly.    A  numerical 

example  with  its  tree- structure  is  presented  in  Appendix  B.        ' 

One  final  note  regarding  this  approach  to  the  selection  of  interdependent 
projects  is  required  here.  Although  Reiter  restricts  himself  to  a  consideration 
of  second- order  interactions  exclusively,  there  is  nothing  in  the  method  which 
requires  this.  A  generalization  to  k   order  effects  requires  computations  in- 
volving an  , 

n  X  n  X  ...  X  n 
array,  for  which  specifying  the  numerical  values  of  the  parameteas  will  be  more 
difficult  than  obtaining  a  good  solution.  Increasing  the  dimensionality  of  the 


^■""In  any  case,  one  would  partition  the  matrix  B  into  independent  submatrices,  if 
such  exist,  and  use  the  method  on  the  submatrices  separately. 
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array  does  not  change  anything  essential  in  the  structvire  of  the  problem — the 
connectedness  or  flniteness  of  the  iterative  process  for  finding  a  local  optimum — 
and  hence  only  the  computational  problems  are  affected,  though  perhaps  drastically. 
rV.   BTTERDEPENDENT  PROJECTS  WITH  BUDGET  CX)NSTRAIKTS 

The  methods  outlined  in  the  previous  section,  in  addition  to  handling 
the  interrelationships  between  projects,  permit  inclusion  of  budget  constraints 
with  varying  degrees  of  difficulty.  For  linear  and  integer  linear  programming 
formulations  the  interrelationships  are  essentially  like  budgets,  and  this  holds 
approximately  for  the  dynamic  programming  formulation,  as  was  discussed  in  Sec- 
tion III.  The  formulation  as  an  integer  quadratic  programming  problem  also 
allows  the  introduction  of  linear  restrictions  such  as  the  budget  constraints, 
although  progress  toward  an  algorithm  for  such  problems  has  not  been  rapid  to 
date.  [18], 

The  only  point  which  bears  a  brief  discussion  in  this  section  is  the  in- 
troduction of  side- conditions  of  the  budget  type  into  the  Reiter  format.  To  ac- 
complish, this  end  with  a  single  restriction  one  may  simply  utilize  a  Lagrangian 
multiplier  as  did  Bellman  in  the  knapsack  problem.  That  is,  the  terms  _c.  from 

the  constraint 

n 

IV.l  ^   CjXj<C     ' 

J=l 

are  Introduced  into  the  matrix  B  of  III.I3  with  the  Lagrangian  X: 

^U.-K    ^12     "13     •"     ^in 
3  °     ^2.-^=.  ^.3     -     \n 

I  •  •  •  •  •  • 

0        0       0      ...    b„„  -  Ac 

nn     n 
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and  the  optimization  procedxire  is  repeated  with  varying  values  of  A  until  restric- 
tion IV. 1  is  met.  This  procedure  is  not  without  pitfalls.  Suppose  a*^  (  M  is 
the  in- list  accepted  as  the  best  obtainable  for  the  given  aspiration  level  (stop- 
ping loile)  and  the  given  value  of  A.  Suppose,  further,  that  a  (  A )  is  the 
optimal  in- list  for  this  value  of  A.  The  difference  between  \o   (X_)  and)  *  (  A_) 

may  arise  (a)  because  larger  b  .  are  available,  or  (b)  smaller  c.  are  available, 

22 
or  (c)  both.    Only  in  case  (a)  are  the  constrained  quantities  c.  not  involved. 

In  both  other  instances,  the  most  likely  case  being  (c),  this  difference  implies 

that  the  global  optimum  (for  the  given  value  of  ^)  will  show  a  greater  amount  of 

slack  or  smaller  surplus  in  constraint  IV. 1  than  does  a   (  _)•  A  reasonable 

procedure  for  changing  \  in  the  direction  indicated  by  the  presence  of  slack  or 

violation  of  the  restriction  would  be  to  begin  the  computations  with  the  previous 


\ 


in-list  a  .  The  grid  for  such  changes  in  A  should  reflect  the  bias  in  the  esti- 
mation  of  the  optimal  value  of  the  Lagrangian  multiplier.  "^  It  should  be  bom  in 
mind,  nevertheless,  that  feasible  solutions,  which  satisfy  the  constraint  IV. 1, 
will  always  be  found  (assuming  that  the  constraint  is  consistent  with  the  interre- 
lationships) even  though  it  is  not  guaranteed  to  be  a  global  optimum. 

One  final  observation  which  will  be  followed  by  a  detailed  discussion 
of  a  particular  application  below  concludes  this  section.  Given  the  discrete 
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The  s..  are  nonnegative  quantities,  and  are  multiplied  by  the  positive  constant 

and  tlTen  subtracted  from  the  b^^. 

iA. 

•^ore  complete  ways  of  handling  this  problem  are  being  investigated. 
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optimization  technique  of  Reiter  the  cost  structure  may  also  express  the  whole 
range  of  second-order  interactions,  generalizing  to  the  following  payoff  matrix: 
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V.   PROBABILISTIC  CONSIDERATIONS 

Introduction  of  probability  distributions  into  the  models  considered 
earlier  cannot  automatically  be  regarded  as  dealing  with  the  problems  of  uncer- 
tainty.  In  the  selection  of  projects  whose  outcomes  are  stochastic,  it  is  not, 
in  general,  clear  what  the  random  variables  are,  or  how  they  are  distributed, 
although  some  attempts  at  the  organization  of  data  have  recently  been  proposed 
More  important,  it  is  not  yet  clear  how  such  outcomes  shoiild  be  evaluated.    We 
shall  wave  these  matters  aside  in  order  to  pursue  our  original  aim  of  clarifying 
and  expanding  on  simple  methods  of  analyzing  the  consequences  from  given  assump- 
tions, hopefully  useful  considering  the  current  state  of  the  art. 
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Should  the  payoff  matrix  be  partitionable  into  submatrices,  as  e.g.,  in 

-Ac,     b^  -X 
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the  problem  may  be  restated  as  V*     t 

Maximize       Z(  )  =  )   (XBX  )j^ 

k=l        » 
where  each  (XB)e)   is  a  similar  subproblem.   The  value  of  A   remains  the  same  for  al 
subproblems  at  any  state  since  the  budget  constraint  applies  to  all  simultaneously. 

^See,  for  example,  [I3]  and  [l^*^]. 

This  problem  remains  conspicuously  unsolved  in  [I3].  However,  see  also  Ll5]» 
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A.  Independent  Investment  Projects 

Even  Investment  alternatives  which  are  independent  in  the  physical 
sense  but  which  have  probabilistic  payoffs  introduce  a  hierarchy  of  difficulties 

in  the  selection  of  an  optimal  set.  The  foremost  of  these  is  the  choice  of  cri- 

27 
terion  function  for  optimization    Confining  oiorselves,  as  before,  to  economic 

benefits,  we  first  look  at  expected  value  maximization.  Under  this  criterion, 
and  assuming  that  the  decision-maker  is  satisfied  that  he  has  defined  meaningful 
random  variables  and  that  he  knows  the  shapes  and  parameters  of  their  distributions, 
we  distinguish  between  sitvtations  where  the  payoffs  are  independently  distributed 
and  where  they  are  not.  For  the  moment  we  consider  the  qixantities  subject  to 
budget  constraints  to  be  certain. 

With  independently  distributed  outcomes  the  problem  has  not  been  altered 
in  any  essential  way.  The  form  of  the  original  Lorie-Savage  problem  still  applies, 
expected  payoffs  being  substituted  for  certain  ones.  Integer  programming  or  dy- 
namic programming  may  be  used  to  solve  the  problem,  as  before,  or  linear  program- 
ming may  be  applied  if  its  limitations  are  not  important  here.  It  should  be 
obvious  that  most  of  the  problems  of  uncertainty  have  been  assumed  away,  although 
a  model  of  this  type  of  uncertainty  has  been  used  [2].  If  the  outcomes  of  invest- 
ments are  jointly  distributed  nothing  new  is  introduced  \mder  expected  value  max- 
imization. The  same  is  not  the  case  if  the  conditional  distribution  of  outcomes 
of  a  part'icular  project,  given  that  another  is  undertaken,  is  different  from  the 
unconditional  distribution.  Such  is  the  case,  for  example,  if  the  profitability 
of  a  manufacturing  facility  is  affected  by  the  decision  to  build  a  warehouse 
nearby.  Such  second-order  effects  may  be  handled  by  quadratic  integer  programming, 
as  in  Section  III.C,  and  solved  by  Reiter's  method  or  our  extensicn  provided  that 


27 

We  are  not  concerned  with  a  general  discussion  of  utility  here^ 


22 
no  more  than  a  single  constraint  is  imposed.  The  off-diagonal  elements  of  the 
payoff  matrix  JB  would  then  ejcpress  the  expected  value  of  the  joint  adoption  of 
two  projects  while  the  diagonal  elements  are  expected  payoffs  from  acceptance  of 
the  projects  by  themselves.  The  costs  would  be  subtracted  from  the  diagonal 
elements,  as  in  matrix  IV. 2. 

B.  Nonlinear  Utility  Functions 

When  the  stochastic  nature  of  the  outcomes  Is  given  prominence  in  the 
problem,  consideration  must  also  be  given  to  the  form  of  the  function  whose  op- 
timization is  being  sought.  Questions  of  risk  aversion  or  risk  preference  lead 
to  inclusion  of  quantities  other  than  expected  payoffs  into  the  criterion  or 
utility  function.  The  meanings  of  the  terms  "risk  aversion"  and  "risk  preference" 
have  been  sharpened  considerably  in  a  recent  paper  by  Pratt  [23],  a  few  of  whose 
conclusions  will  be  referred  to  below.  This  subject,  which  is  intertwined  with 
the  concept  of  xincertainty,  raises  such  additional  Issues  as  whose  utility  should 
be  optimized,  as  well  as  the  effect  of  expectations  concerning  the  availability 
of  future  prospects  on  the  current  decision.  The  latter  difficvilty  has  already 
been  relegated  to  another  time  by  omitting  consideration  here  of  sequential  de- 
cision procedures.  The  former  we  leave  to  others,  assianing  that  a  determination 
can  be  made  by  the  decision-maker. 

As  Markowitz  has  pointed  out  [21,  91  the  step  to  the  simplest  nonlinear 
utility  function  can  be  taken  directly  or  Indirectly.  First  one  may  assume  that 

the  utility  function  is  quadratic.  Unfortunately,  the  quadratic  is  not  rlsk- 

28 
averse  in  Pratt's  sense.    However,  if  all  outcomes  are  normally  distributed 


28 

One  consequence  of  the  quadratic  utility  function  is  that  the  "risk  premium" — 

that  additioneil  amount  which  makes  a  fair  gamble  acceptable  to  a  risk-averse 

gambler — increases  with  his  initial  weeQ.th. 
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only  the  mean  and  variance  of  the  total  payoff  enter  into  the  utility  function, 

reducing  the  utility  function  to  a  quadratic.  We  assume  first  that  the  outcomes 
normally 

are  Jointly /distributed,  but  that  the  distributions  are  not  contingent  on  the 
decisions  themselves  as  in  the  preceding  section.  The  resulting  problem  has  a 
form  exactly  analogous  to  the  Markowitz  Portfolio  Selection  problem  with  the  fol- 
lowing exceptions.  First,  the  projects  are  discrete,  unlike  the  portfolio  problem 
in  which  for  a  given  security  there  are  constant  returns  to  scale.  As  a  result, 
the  problem  is  not  to  determine  the  proportion  of  the  portfolio  to  be  allocated 
to  each  eligible  security,  but  to  determine  the  list  of  projects  to  be  accepted. 

Formally,  this  problem  may  be  written  as  - 

n  n    n 

Maximize     )i  -  AD"^  "    )     ^^^     "  ^/    /    ^i'^il^j 
V.l  i=l  i=l  j=l 

subject  to   x.  "  \ -,}    i=l,  ...,n 

2 
where  u  is  the  expected  value  of  the  payoff  of  the  accepted  projects  and  0|  is 

the  variance  of  the  total  payoff.  The  quantity  A   here  has  an  interpretation, 

being  a  measure  of  risk  aversion — the  rate  of  trade-off  between  reduction  in 

expected  value  for  reduction  in  variance.  Thus  u  is  the  sum  of  the  expected 

payoffs  u     from  the  individual  projects  which  are  accepted.  The  (T^  .  are  the  cov- 

ariances  between  the  outcomes  of  projects  i  and  ^,   _i  y^  j.*  and<^.  .  "  0\   are  the 

~      2 
variances.  Since  we  have  restricted  the  values  of  x.  to  zero  or  one,  x^  "  ii^* 

and  functional  V.l  has  a  form  similar  to  one  treated  before  by  Reiter's  Discrete 

Optimization  Method: 
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We  may  contrast  this  formiilation  vd.th  the  one  recently  suggested  by 
J.  Cord  which  was  referred  to  earlier.  Cord  considers  the  problem  of  "optimally 
selecting  capital  investments  with  uncertain  returns,  under  conditions  of  limited 
funds  and  a  constraint  on  the  maximum  average  varismce  allowed  in  the  final  in- 
vestment package  "  i^,   p.  335]*  Although  Cord's  figure  of  merit  is  "interest 

rate  of  return"  of  a  project  which  is  multiplied  by  the  required  outlay  for  the 

29 
project,   nothing  essential  is  changed  by  substituting  the  expected  present  value 

for  this  quantity.  Similarly,  the  variance  of  the  present  value  may  be  used  in 

30 
place  of  the  variance  he  uses.-'   Cord  solves  this  problem  by  dynamic  programming 

utilizing  the  Lagrangian  multiplier  technique  to  obtain  a  solution  which  satis- 
fies the  constraint  on  variance.  Using  the  notation  of  the  preceding  paragraph, 
we  may  restate  his  recurrence  relation  as 
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In  his  discussion,  Cord  indicates  that  by  "interest  rate  of  return"  he  means  in- 
ternal rate  of  return — that  rate  which  equates  the  discounted  value  of  inflows  to 
the  (assiOTed  by  Cord,  sole)  outflow.   For  this  he  was  properly  criticized  by 
T.R.  Dyckman  [8]  because  of  the  effect  of  project  lives  on  total  benefit.  Actu- 
ally, Cord's  use  of  this  quantity  is  not  consistent  with  application  of  the  in- 
ternal rate  of  return,  which  he  multiplies  by  the  outlay  to  obtain  the  figure  of 
merit  used  in  the  objective  function.  His  model  can  be  made  consistent,  however, 
simply  by  interpreting  "interest  rate  of  return"  as  the  uniform  perpetual  rate 
of  return. 

Cord  introduces  a  slight  error  into  his  solution  by  his  weighting  of  the  variance 
of  returns  when  not  all  available  funds  are  allocated.   The  weight  £./C  in  our 
notation  is  then  too  small,  and  as  a  result,  the  constraint  on  the  average  vari- 
ance may  be  violated. 
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V.3  t^iC  )   "   max   [^^x^  -  A<r  ^x^   +  f^_^   (C  -  c^x^)] 

CKx.51 

q<c'<c 

where  C     Is  the  unallocated  budget  and  f .  the  total  value  of  the  selected  pro- 
jects  when  C     remains  to  be  allocated  and  n  -  1  projects  have  been  considered, 

Cord  explicitly  assumes  independence  in  the  statistical  sense  between 
the  project  payoffs.  Hence  his  total  variance  is  the  sum  of  the  variances  of 
the  accepted  projects,  avoiding  the  quadratic  terms  and  covariances.  Although  it 
simplifies  the  computations,  this  assumption,  which  he  has  difficulty  in  justi- 
fying, is  not  strictly  necessary  for  application  of  dynamic  programming.  Having 
consciously  patterned  his  approach  after  Markowitz  he  might  also  have  considered 
Sharpe's  Diagonal  Model  [26a]  which  is  designed  to  simplify  the  computations  for 
obtaining  optimal  portfolios  by  allowing  only  a  restricted  covariance  between  the 
eligible  securities.  1 

Specifically,  Sharpe  assumes  that  the  returns  on  securities  are  related 
only  through  a  relationship  with  some  common  factor,  e.g.,  an  index  of  genei^l 
activity.   If  the  random  variable,  the  return  on  the  ±       security,  is  denoted 
by  2j  >   and  the  level  of  the  index  is  _I,  he  expresses  this  return  by 

V.i+  ^i  "=  Hi  +  ^i^  +  ^i 

where  u.  and  P.  are  parameters,  and  w.  is  a  random  variable  with  mean  of  zero  and 

~  2~  ~ 

variance  of  g;^  .   Further,  the  level  of  I  is  given  by  the  sum  of  a  systematic 

~  2 

component,  u  ,  and  a  random  part,  w-r^  with  mean  of  zero  and  variance  of  a~  j, 

V.5  ^  "  /^T  **■  ^T* 
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Putting  these  relations  together,  with  the  assvanption  that  Gov  (w. >  v.)  a  0 
he  obtains 

Exp  (p^)  =  }ijL  +  3i(fij) 
V.6  Var  (p^)  =0-^^  +  p^'T^ 

Gov  (Pi,Pj)«=  3i3j<r^ 

In  the  portfolio  problem  the  unknowns  are  the  proportions  of  the  total 
amount  invested  which  are  allocated  to  various  securities.  ^  contrast,  our 
variables  are  integer-valued;  x.  =  0  or  1.  Hence  we  may  maximize  total  expected 


investment  program  payoff  u  subject  to  aln  expenditure  ceiling  of  C  and  a  variance 

2  \   2 

limit  of  £■  ,  or  alternatively,  maximize  payoff  less  ACT  subject  to  the  budget 

constraint,  where 


n 

V.7  ;i  =  ^  (Yl  -^  ^ifj)  ^ 

i=l 

1=1  1=1 

The  recurrence  relation  may  then  be  written  as 

1-1 


V.9    f  (C  )  =   max 


CKx  <1 
0<C'<C 


[/^l^l  -  ^^1  l^l   *  ^?  ^^l  -"^h    Z^j^j))  ^  ^i-l(^'  -  ^1^1^ 


where  the  term  enclosed  in  braces  resvilts  from  the  factoring 

1  1 

V.IO  ^^^  J"^ 

1-1         1-1  1-1 
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j=i       j=i  j=l 
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Contrary  to  Cord's  viewpoint,  the  Lagrangian  multiplier  formulation  above  has 
the  advantage  here  of  tracing  out  a  variety  of  efficient  investment  programs  in 
the  Markowitz  sense"'  instead  of  requiring  the  decision  maker  to  specify  his 
tolerance  for  variance  abstractly. 

Utilization  of  an  index  to  capture  the  major  effect  of  covariation 
seems  more  appropriate  In  our  context  than  in  portfolio  selection.  For  a  single 
product- line  firm,  the  payoffe  from  capital  expenditures  are  apt  to  be  related 
to  each  other  mostly  through  a  variable  such  as  total  sales.  An  extension  of 
Sharpe's  work  to  a  number  of  uncoiTelated  Indexes  by  K.  J.  Cohen  [1]  doubtlessly 
may  be  applied  within  this  framework  also.- 

C.  Interdependent  Inves-tments  with  Probabilistic  Returns 

Taking  cognizance  of  covarlance  between  investment  payoffs  may  be 
thought  of  as  the i simplest  foim  of  Interdependence,  and  strict  independence  in 
our  original  sense  does  not  apply.  However,  it  is  still  necessary  to  consider 
such  explicit  interrelationships  as  mutual- exclusion  and  dependence  in  order  to 
see  what  these  concepts  imply  given  that  outcomes  are  random  variables. 

Continuing,  then,  with  Jointly  normally  distributed  payoffs  from  all 
investments  (thus  narrowing  ovir  concern  to  mean,  variance  and  covarlance),  we 
observe  first  that  the  choice  among  mutually- exclusive  investments  in  the  absence 
of  budget  or  other  constraints  cannot  be  made  without  reference  to  the  whole  set 
of  alternatives.  That  is,  if  the  projects  within  set  J  are  mutually- exclusive, 
so  that  acceptance  of  more  than  one  of  them  can  be  iniled  out  in  advance,  the 
quantities  ji  and  £".,  J  £  J*  are  Insufficient  for  selection  of  the  preferred  one 
(if  any).  The  covarlances  between  the  mutually- exclusive  project  and  the  inde- 
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I.e.,  one  with  minimum  variance  for  given  mean,  or  maximum  mean  for  given  variance. 
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pendent  ones  enter  Into  the  choice,  which  may  be  formulated  once  more  as  a  quad- 
ratic Integer  program  solved  by  use  of  Relter's  method: 

2  cr. 

In 


v.n  B 


-<'.' 

-M 

-2  cT 
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M2  -  cr/ 

-^'^23 
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H3  -  cr3^ 

2n 


-^<^3n 


\o  0  0  ...      u-cr^ 

'  n     n 

In  V.ll,  projects  1  and  2  are  considered  mutually- exclusive,  introducing  the  pen- 
alty -M  into  the  second  column  of  the  first  row  to  prevent  their  joint  acceptance. 

■52 
The  matrix  otherwise  resembles  V.2. 

Great  care  must  be  excercised  in  utilizing  this  approach  for  the  gener^ 

alized  second  order  effect  matrtx,  as  in  III.I3.  A  difficulty  arises  around 

the  meaning  of  the  covariance  terms,  0]  ,  when  the  off-diagonal  elanents  include 

expected  values.  Consider,  for  example,  a  machine  tool  for  which  accessories 

are  available  which  increase  the  range  of  products  which  the  machine  can  produce, 

and  at  the  same  time,  increase  its  reliability.  We  can  consider  the  tool  itself 

project  r,  its  accessories  project  _s,  and  thus  denote  the  random  payoff  from 

the  machine  tool  alone  by  b   with  expectation  u and  variance  (T  ;,  the  cost  of 

— rr  •'-rr  — rr 

the  accessories  by  b   «»  u  ,  with  <f     "0;  and  the  increase  in  payoff  due  to  the 
"  — ss   ^ss      — ss 

accessories  by  b   with  expectation  of  u   .  However,  we  shall  need  (T  to  de- 
>'  — rs       -^  *-rs         '  — rs 

note  more  than  the  variance  of  b  .  If  we  define  Tf      =b   +b   +b„,  i.e., 

— rs  — rs   — rr   — rs   — ss'     ' 

TT   is  the  payoff  from  the  compound  projects,  and  V   is  its  vairiance,  then 
•^rs  ^rs 


■32  *  * 

•^   There  is  obviously  no  need  for  OT.  _  since  the  -M  will  rule  out  x,  «=  1/  Xp  °  ^ 

from  the  optimal  solution. 


29 

V.12  V  «  "  ^  +  ^n»    +  0"  a   "  0^^  +  Cfl 

rs    IT    SB    rs     IT    rs 

or     (feV-CT-CreV^-^. 
rs    rs    IT    ss    rs    rr 

With  these  definitions  it  is  possihle  to  treat  complex  interrelationships  by 

use  of  Reiter's  method,  although  the  data  preparation  requires,  in  effect, 

computing  the  parameters  of  aJLL  possible  (or  likely)  compoxmd  projects,  which 

could  then  be  handled  via  matrix  V.ll  Just  as  well.  Using  this  earlier  method 

also  has  the  advantage  of  preserving  the  meaning  of  the  covariance  term  between 

independent  projects  which  would  be  clouded  when  covariances  between  a  dependent 

project  and  unrelated  independent  projects  are  needed. 

A  final  note  regarding  the  quantities  subject  to  budget  constraints 

is  needed  before  this  section  may  be  concluded.  We  have  assumed  that  these  are 

known  with  certainty.  Should  they  also  be  regarded  as  stochastic  the  character 

of  the  problem  would  change  in  a  significant  way.  One  alternative  would  be  to 

make  compliance  wH;h  the  constraint  less  rigid,  e.g.,  by  stating  only  a  probability 

less  than  unity  with  which  the  condition  must  hold.  This  places  the  problem 

into  the  realm  of  chance  constralnted  programming  [ha.].     Another  would  be  to 

proceed  sequentially  in  the  allocation  process,  to  make  certain  that  expenditures 

stay  within  the  preset  ceilings.  The  latter  problem,  which  may  be  formulated 

as  a  dynamic  programming  problem,  does  teike  us  outside  the  framework  set  for 

this  paper  and  will  be  taken  up  elsewhere. 

VI.   R&D  PROJECT  SELECTION 

A.  Expected  Value  Maximization 

The  final  section  of  this  paper  is  devoted  to  consideration  of  an 

additional  class  of  project  interrelationships  which  can  arise  in  the  context 

of  constructing  a  research  and  development  program.   In  order  to  concentrate 

on  those  aspects  we  consider  a  drastically  simplified  problem  in  which  the  payoff 

from  one  successful  development  of  a  product  or  process  is  known  with  certainty 
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(again  denoted  by  b. ),  in  which  the  development  cost,  c  ,  is  similarly  known 
with  ceirtainty,  and  in  which  the  probability  of  success  is  believed  to  be  £. 
for  a  single  project  d.. 

If  projects  are  mutually  independent  in  all  respects,  acceptance  is 
contingent  only  on  the  condition 


VI.  1 


p^b^  -  c^  >  0. 


Where  simultaneously  resource  limitations  are  also  imposed,  the  problem  has  the 
format  of  the  original  Lorie- Savage  problem,  and  the  methods  offered  for  this 
still  apply.  The  project  payoff  is  now  given  by  the  left  side  of  VI. 1.  This 
much  is  of  little  interest.  Consider,  however,  two  projects,  r  and  s   which  are 
mutioally- exclusive  in  the  following  sense.  They  may  represent  alternative  products 
to  serve  the  same  function,  or  products,  e.g.,  chemicals  or  drugs,  synthesized 
by  two  different  methods.  Then  it  may  be  that  if  research  on  both  projects  is 
undei-taken  and  success  is  achieved  on  both,  only  the  better  project  will  actually 
be  taken  jjast  the  development  stage.  Thus,  if  b  >  b  ,  and  p   is  the  probability 
of  success  on  both  projects  _r  and  £,  then  the  payoff  from  undertaking  research 
on  both  is  given  by  the  applicable  box  in  the  following  payoff  matrix: 

Success  on  r  Failure  on  r 

Success  on  s 

Failure  on  _s 

The  expected  payoff  then  is 

VL.2    TT   =p(b  -c  -c)+(p  -p  )(b  -c  -c)  +  (l-p  -p  +p  )(-c-c] 
"rs   -^r^  r    r    s'   ^-^s   -^rs'  ^  s    r    s'   ^    ■'^r   -^s   -^rs'^  r  s' 

=  pb+(p-p)b-(c+c) 
r  r   ^"^s   -^rs'  s   ^  r    g 

and  in  the  absence  of  budgets  the  decision  to  undertake  both  is  based  on  a  compari- 
son of  TT   with  the  expected  peiyoff  On  the  better  of  the  two  projects  alone, 
where  "better"  means  a  higher  expected  value  of  the  undertaking.   Thus,  if 


b     -    c     -   c 
r         r         8 

b     -   c     -   c 
8         r         s 

b     -   c     -   c 

r         r         8 

-   c     -   c 

r         8 
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VI.  3        pb-c>pb-c 
r  r    r   -^^s  s    B 


then        1T^„  >  p  b  -  c^    IraplleB 


Vl,k  (p  -  p_)  b  -  c  >  0 


^   °8 

Ps  -  Prs  >  b- 

s 


and  research  on  both  should  be  \uidertaken.  If  the  inequality  VI. 3  were  reversed, 
even  though  b  >  b  as  is  assumed  in  71.2,  then  the  comparable  criterion  would 
require 


i^ 


VI.5         P  b  -  c  >  p  b  . 
"^r  r    r   -^^rs  s 

This  argument  may  easily  be  generalized  to  an  arbitrary  number  of  alternatives. 
Where  consideration  of  such  mutually- exclusive  alternatives  is  to  be  made  along- 
side independent  ones  (to  be  discussed  below)  the  matrix  formulation  of  Reiter 
again  suggests  itself: 

^pb-c        -pb       

r  r    r       -^rs  s 

0        p  b  -  c      

VI. 6     B  «=     I  -^s  s    s 

0  0         

Should  both  projects  £  and  _s  be  selected  the  payoff  using  VI. 6  is  the  sarae  as  in 
VI. 2.  In  the  matrix  foimulation  it  is  possible  to  add  an  additional  term,  c 
(which  may  be  positive  or  negative),  to  express  an  adjustment  to  the  total  develop- 
ment costs  resulting  from  the  joint  development  program.  This  formulation  also 
lends  itself  to  the  simultaneous  consideration  of  three  or  more  projects  which 
are  mutiially- exclusive  in  this  special  sense.  However,  for  every  additional 
project  we  require  an  additional  dimension  in  the  array,  the  need  for  which  arises 
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from  a  term  Involving  £.  .,    ,  the  joint  probability  of  success  on  aJLl  such 
projects. 

Additional  Interrelationships  can  arise  when  the  probability  of  success 
on  one  project  is  affected  by  the  undertaking  of  research  on  a  non- competing 
project  as  when,  for  example,  the  research  embodies  similar  approaches  or  in- 
strumentation. These  effects  may  be  reciprocal,  though  not  necessarily  symmetric. 
A  project  r  may  involve  a  process  Jointly  with  _s,  so  that  if  both  develojanents 
are  undertaken  the  probability  of  success  on  each  is  enhanced.  However,  it  may 
be  that  the  Joint  process  is  only  a  small  part  of  the  problem  involved  in 
project  B   although  it  comprises  the  major  component  of  project  r.  Hence,  if 

we  denote  by  p   the  probability  of  success  on  project  r  given  that  project  s  is 
^rs  —  ^ 

It  mav  be  that  x       ,    ^      . 
i>rs  '  -isr 


also  undertaken   it  may  be  that  £  _  >^  £  •  Hence  we  require  a  nonsymmetric 


matrix  P: 


VI.7  B= 


Pn 

Pl2 

■'"13 

•  •  • 

Pin 

^21 

P22 

•  •  • 

'^23 

1 

•  •  « 

•  •  • 

P2n 

Pnl 

Pn2 

Pn3 

•  •  • 

Pnn 

where  £. .  represents  the  probability  of  success  on  project  1  taken  by  itself. 
This  may  be  combined  with  a  diagonal  payoff  matrix  B  and  the  triangular  cost 
matrix  C,  viz.. 


VI.8    B=       u   02   ^   •••   ^       C  = 


"1 

^2 

^13 

•  •  • 

^in 

0 

=2 

^=23 

•  •  • 

^2n 

0 
0 

0 
0 

^3 
0 

1*  •  • 

«  »  • 
•  •  • 

^3n 

c 

n 

This  is  a  change  in  definition  from  that  used  above • 
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in  the  quadratic  integer  prograamlng  problem 

VI. 9  Maximize      X[BP  -  C]X* 

where  X  is  a  vector  of  x-  as  before.  The  quantity  in  brackets  is  a  matrix  vhich 
may  be  solved  using  Reiter's  method.  In  addition,  a  budget  constraint  may  be 
placed  on  the  expenditures  _c. .  by  utilizing  a  Lagrangian  multiplier,  as  in 
Section  IV,  which  may  be  represented  by 

VI. 10  Maximize      X[BP  -  (l  -  >)CJX* 

for  various  values  of  ^.  We  may  substitute  X'  for  the  term  (l  -  X)  and  solve 

VI. 11         Maximize      X[  BP  -  X'  C]X*. 


wnere 


/ 


VI. 12        BP- A'C  = 


PiiV>'''=i 

Pl2V>'''=12 

Pl3VX'Ci3 

P2l\ 

P22V>^'°2 

P23V>^'°23 

^31^ 

^32^ 

^33V^'^3 

Finally,  the  methods  for  handling  mutioally- exclusive  projects  and  mutually  inde- 
pendent projects  may  be  combined.  Some  of  the  columns  of  VI. 12  would  then  be  as 
3iven  in  matrix  VI. 6,  with  _£   as  defined  there,  and  with  terms  below  the  dia^jonal 
as  defined  for  VI. 12. 

B.  Nonlinear  Criterion  3?unctions 

Nonlinear  utility  or  criterion  functions  give  rise  to  a  host  of  considera- 
tions not  present  when  expected  value  maximization  serves  as  the  criterion.  A 
brief  discussion  of  some  of  the  issues  in  the  context  of  R  &  D  project  selection 
\riH   conclude  this  presentation.  As  before,  we  continue  to  regard  the  objective 


''   The  matrix  _C  is  still  triangular  since  terms  _c.  .  enter  only  once. 
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of  the  decision  maker  to  select  the  set  of  projects  which  maximizes  expected 
utility,  but  the  utility  function  is  not  linear  in  the  outcomes.  For  simplicity 
ve  shall  illustrate  our  remarks  by  reference  to  a  quadratic  utility  function, 

VI. 13  U(y)  =  y  -  oy^ 

recognizing  that  his  criterion  is  Increasingly  risk  averse  in  Pratt's  sense  [23]. 
For  present  purposes,  however,  it  is  adequate,  (a  here  is  the  coefficient  of  risk 
aversion). 

The  first  observation  to  be  made  is  that  the  assumption  of  a  static 
decision  procedure,  i.e.,  one  which  falls  to  take  Into  account  other  decisions 
which  have  been  made  in  the  past  and  will  be  made  in  the  future,  is  no  longer 
tenable.  Utility  is  defined  for  the  entire "xKjrtfollo"  of  projects,  including 
both  the  project  being  considered  and  those  already  accepted  and  in  process  of 
being  carried  out.  Consider,  under  perfect   certainty,  an  existing  portfolio  of 
value  ^  and  two  potential  projects,  worth  _z^  and  _z^.  From  VI. 13  we  may  express 
the  utility  of  a  sum  of  two  outcomes,  ^  +  _z,  by 
VI.li<-  U(y  +  z)  =  U(y)  +  U(z)  -  2CCyz 

so  that,  given  ^,  the  requirement  for  acceptance  of  z  is  an  Increase  in  total 

utility.  Since  ^  is  not  subject  to  reduction  (unlike  the  securities  portfolio 

of  Markowitz)  the  condition  for  acceptability  reduces  to 
VI. 15             U(z)  >  2Q;yz         ' 

With  two  potential  Independent  projects  with  payoffs  of  z.   and  _z^,  the  outcome 
of  a  decision  procedure  based  on  criterion  VI. 15  alone  co\ild  depend  on  the  order 
in  which  the  projects  were  considered.  If  project  one  were  taken  up  first, 
acceptance  of  both  would  reqiilre 
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VI.16  a)   U(z^)  >  2az^y 

b)   uCzg)  >  aazg  (y  +  z^)  »  2az2y  +  2az^z2 

if  the  first  had  been  accepted.  Alternatively,  taking  up  the  decision  about  the 
second  project  first  reqiiires 

VI.17  a)   uCzg)  >  2az2y 

b)   U(z^)  >  2az^  (y  +  z^)  =  Saz^y  +  2az^Z2 

if  the  second  project  had  been  accepted.  Suppose  that  both  projects  would  be 
acceptable  if  they  were  the  only  ones  being  considered,  i.e., 

VI. 18  a)  \j(z^)  >  2az^y 

b)   uCzg)  >  2az2y 
but  that  while 
VI.19  U(z^)  >  2az^  (y  +  Zg) 

also 

VI.20  UCzg)  <  2az^   (y  +  z^). 

Given  such  values  of  _z. ,  _z^  and  ^,   the  second  project  would  be  accepted  only  if  it 
were  taken  up  first,  while  this  restriction  would  not  apply  to  the  first  project. 
It  is  clearly  undesirable  for  a  decision  procedure  to  depend  on  the 

order  in  which  projects  are  taken  up.  Yet,  this  would  be  the  effect  with  naive 

'  35 

application  of  a  nonlinear  utility  function.    While  it  Is  true  that  both  projects 

_r  and  _s  would  be  accepted  given  the  condition  of  accepting  both  or  neither, 

maximization  of  expected  utility  would  lead  to  acceptance  of  project  r  alone.  This 


35 

-^^Although  these  illustrations  make  use  of  a  quadratic  utility  function,  the  con 

elusion  applies  to  a  large  variety  of  nonlinear  cidterion  functions,  in  particu- 
lar also  to  ones  which  are  decreaslngly  risk  averse. 

3^  U(y  +  z^+z^)  >  U(y). 
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may  be  seen  by  regarding  VI.19  as  an  equation,  and  rewriting  VI.l8b  as 

VI.21         U(zg)  »  aazgy  +S,  £  <  aaz^z^. 

Rx»m  these  one  may  derive 

a)     U(y  +  z^)  =  U(y)  +  U(z^)  -  2CXyz^  =  u(y)  +  2az^z^ 
VI.22  b)     U(y  +  Zg)  E  U(y)  +  uCz^)  -  2Ctyz^  -  u(y)  +  £  <  U(y)  +  2az^Z2 

c)     U(y  +  z^  +  Zg)   5  U(y)  +  V(z^)  +  uCz^)  •  2a(yz^  +  yz^  +  z^Zg)  =  U(y)  +£ 

<  U(y)  +  Saz^z^ 

leading  to  the  stated  conclrislon. 

An  additional  complication  when  the  outcomes  are  random  variables  (as 
i 
they  are  in  the  present  context),  is  that  jjr  Itself,  the  value  of  the  previously 

accepted  portfolio,  is  also  random.  This  reqizires  that  the  joint  distribution 

of  the  outcomes  of  present  and  potential  projects  must  enter  the  calculations. 

In  the  stirictly  static  case  in  which  selection  is  to  be  made  so  as  to 

maximize  the  utility  of  the  projects  being  chosen  without  regard  to  i)ast  selections, 

we  first  derive  the  criterion  for  the  Markowitz-type  of  R  &  D  project  portfolio 

consisting  only  of  projects  which  are  not  interrelated  in  the  physical  sense. 

Statistical  Independence,  however,  is  not  assumed.  We  begin  with  two  Independent 

projects,  and  generalize  from  there.  Given  two  projects  _r  and  _s  with  development 

costs  (negative  revenues)  of  (-c  )  andi (-o  ),  with  net  present  values  after 

"•r       ""S 

successful  development  of  b  and  c.   and  with  probabilities  of  £   of  joint  success, 

(2  -£  )  and  (2  -£  )  of  success  on  r  alone  and  _s  alone,  respectively,  expected 

utility  from  acceptance  of  both  projects,  U  „,ls  given  by 

^rs 

VI.23       U^3  «  P^3  U(b^-C^  +  b^-C^)  +  (P^-P^g)  U(b^-C^-Cj  +  (P3-P^3)  U(b3-C3-C^) 

+  (1-Pr-P3  +  P^g)  U(-C^-C3) 
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which  simplifies  to 

VI.24  U^  »  U  +  U  -  2a  E 

rs    r    s      rs 

vhere 

VI.25  Uj  »  pj  U(bj  -  Cj)  +  (1  -  pj)  U(-  Cj) 

and37 

VI.26  E^j  =  p^jb^bj  -  p^b^cj  -  pjbjc^  +  c^c^. 

Expression  VI. 24  may  be  generalized  to  any  number  of  independent  projects,  so 

that  mazimization  of  expected  utility  from  acceptance  of  a  set  of  projects  nay 

be  written  in  terms  parallel  to  model  V.l,  viz., 

n  n   n 

VI. 27       Maximize  li     y  U.x  -  2a  y  J     x.E.  .x. 

i=l         i=l  j=i+l 

subject  to   X.  s=  \  ^,  i=l.  ...,n 

which  is  once  more  in  a  form  suitable  for  solution  by  Reiter's  method,  with 
payoff  matrix 


VI. 28  B 


"l  -   2«El2 

-2aE^      • • • 

-^in 

0         U^ 

-2aE22   ••• 

-2aE2„ 

0         0 

u 

r'^bn 

0         0 

0           •  •  • 

\ 

A   budget  constraint  may  be  appended  here  by  use  of  a  Lagrangian  multiplier. 

Unfortunately,  the  relatively  simple  structure  of  VI. 28  is  lost  In 
the  face  of  any  nijmber  of  the  project  interrelationships  already  discussed.  We 
single  out  one  of  these,  the  situation  in  which  if  parallel  research  is  under- 
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Note  that  the  term  E. .  is  simply  the  product  of  expected  outcomes, 

(2iJB.i   "  £i )  (^v^l  "  £i)  with  the  term  jg.^^b.b.  replaced  l3y£j4b^^^« 
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taken  and  success  is  achieved  on  both  lines  of  attack  only  the  project  vlth 
higher  expected  i)ayoff^  is  actually  carried  out.  For  two  such  projects,  r  and 
£,  the  expression  for  expected  utility  corresponding  to  VI. 23  is 

VI.29     U^3  =  p^  U(b^-V°s)  +  (V^rs)  U(V°s-°r)  +  (^-V^s  +  ^rs^  "("'^r'^s) 
which  reduces  to 

VI. 30     U   =U+U-2aE   -p   [U(b  )  -  20Jb  (b  -c  -c  )]. 
-"      rs    r    s     rs   *^rs   ^  s'     s^  r  r  s' 

Aiding  an  independent  project,  v,  however,  requires  introduction  of  terms  in- 
volving 2  ^  the  probability  of  joint  success  on  projects  jr,  s   and  v  into 
jj   .  hence  losing  the  Important  property  of  sieparability,  which  has  been  the 
chief  characteristic  of  our  models  of  capital  budgeting  of  inteirrelated  projects. 


r^n 

This  quantity  strictly  should  be  expected  utility.  However,  we  can  make  our 
point  without  opening  a  pandora's  box  of  problems  of  evaluating  the  utility 
of  future  events  today,  expecially  without  complete  knowledge  of  the  future 
outcomes  which  will  obtain  then. 
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APPENDIX  A        FLOW  CHART  OF  THE  DYNAMIC  PROGRAMMING  CODE  FOR  CAPITAL  BUDGETING^^ 

The  program  flow- charted  was  written  in  FORTRAN  with  the  exception  of  the 
sti'stTgy  vectors  and  their  manipulation.  Since  these  consist  of  strings  of  zeros 
and  ones,  memory  si)ace  and  time  was  conserved  by  programming  these  in  binary  arith- 
metic. The  program  as  written  allows  for  a  maximxan  of  5OO  strategies  at  each  stage 
and  is  able  to  handle  twenty  separate  constraints.  Cord's  problem  [8,  p.  Z^O]   in- 
volving 25  projects  was  solved  in  63  seconds  on  an  TM  709^.  For  a  rough  estimate, 
this  compares  with  12  minutes  reported  by  Cord  in  his  application  of  the  Lagrangian 
multiplier  technique,  but  using  an  IH4  7070.  As  pointed  out  in  the  text.  Cord 
failed  to  obtain  the  optimum,  and  the  timei  to  reach  it  would  have  necessitated  a 
minimum  of  lU^  additional  time.  The  program  was  also  tried  out  on  a  number  of  in- 
terdependencies,  the  total  number  of  constraints  actually  utilized  in  any  one  prob- 
lem was  six.  Three  additional  constraints  in  Cord's  problem  increased  the  time 
utilized  to  90  seconds. 
The  definitions  used  in  the  flow  chart  are  as  follows:        I 

NN  =  No.  of  projects  in  problem      ■■<     IM  =  No.  of  constraints  in  problem 

N(i)  =  No.  of  strategies  at  stage  I    M  «  Maximum  number  of  strategies  permitted 

b.  =  payoff  on  project  i  C.  =  amount  of  resource  of  type  j  available 

c. .  =  amount  of  resource  of  type  j  used  by  project  i 

b  =  (b^,b2,...bjjj^)      Cj  =  (c^j,C2j,...,Cjjjj^^)       C  =  (0,C^,C2,...,C^^) 

p(i)  =  (V^ii'-°i2"-"-^i,m) 

R(I)  =  (b^,C^-c^^,C2-c^2"--'°IM"%M^ 

X(l)  =  (0,0, ...,0,1,0, ...,0)  with  1  in  the  i   position 

X(J)  =  j   strategy,  i.e.,  a  vector  of  O's  and  I's  with  1  in  the  i   position  if  x  =1 
r(j),T(j)  =  (C  -  (-b, c^, Cp...,c  )  [X(J)]  )  ,  a  vector  of  payoffs  and  unused  re- 
sources of  the  j   strategy.  T(J)  is  a  temporary  list,    (j)  is  the  revised  list. 
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The  program  was  written  by  Stanley  Sachar  and  David  Nessi 


■HEAD 
S(I),P(I) 

INTPIALIZEJ 


UO 


The  sym'bol  >  for  vector  Inequalities  denotes  "is  lexico-  ^ 
graphically  greater  than;"  i.e.,  A>  B  implies  the  first 
non  zero  element  of  A  -  B  is  greater  than  zero. 


I-  2 


NO 

N  (I)  -  N  (I)  -  1 

XES^ 


fES 


J=  1 


i 


END 


N(I)  =  1 


JL 


NO 


.YES 


R(l)>P(j)h*N(l)  =  N(I)  +1 


R(l)>r(J)) 


NO 


T(j)  =  r (J) 


NO 


YES 


K=  J 


^J  >  N(I  -  1) 


YES 


T  (j)  «  0 


■X(J  +  M)  =  X(J) 


J  =  J  +  1 


r(j)  >  R(i) 


.YES 


NO 


f(l)  «  N(I  -  1) 


?(K)  »  r(K) 

h 


V , 


J  =  J  +  1 


J  >  N(l  -  1)) 


jX(K  +  M)  =  x(k) 


T(J)  =  R(I) 


K  =  K  +  1 


X(J  +M)  =  X(l) 


NO  .(K  >  N(I)  -  1  ]  YES 


;  YES 
^ 


N(l)  =  N(I  -  1)  +  1 


T(K)  =  R(I) 


KN  =  N(l)  -  1 


YES 


X(KN  +  M  +  1)  »  X(KN)~|-<4iai  =  KN  -  1 


.Jm 


>  K\ NO  Jx(K  +  M)  »  X(I)| 


YES      j 

(k  >  n(i 

-1)\     NO 

-1 

K  =   K  + 
i 

-J. 

^  T(K  +  1) 

1 

-"r(K)l 

..       r 

1^1 


K»  1 


J  =  1 


K=  1 


R(i)  =  p(i)  +  r(j) 


01   NO  H 


J  =  J  +  1 


YES 


NO, 


XCt(k)  >  0  y^  r(K)  o  T(K) 


X(K)  =  X(K  +  M) 


NO 


N(I)  =  N(I)  -1 

I 


K  =  K  +  1 


KL  =  K 

I 


K>K(I)V!^ 


T  (KL)  «  T  (KL  +  1)\*- 


X  (KL  +  M)  «=  X  (KL  +  M  +  1) 


YES 


I 


NO 


YES 


KL  «  KL +T{ »(^>  N(i)    J 


J  >  N(l-l) 


YES 


NO 


R(l)  >  T(K) 


YES 


T(K)  =  0 


K  =  K  +  1 


K  >  N(I) 


NO 


YES 


L 


T(K)  >  R(I)) 


YES 


X(K  +  M)  =  X(I)  +  X(J) 


N  (I)  =  ii  (I)  +  1 


T(K)  =  R(I) 


NO 


± 


R(I)  >  T(K)] 


YES 


T(L)  =  R(I) 


NO 


v_ 


L  =   K 


K  =  K  +  1 


NO 


.NO 


YES 


_Jx(L  +  M)  =  X(I)  +  X(J) 


J^^— /ln>l^     ^ 


K  >  N(l)r"    >/T(K)  >  R(ir 


YES 


LN  =  LN  -   1 


N(I)  =   N(I)  +  1 


LN  =  N(i)  -if 


T(LN  +  1)  =  t(ln) 


I 


X(LN  +  M  +  1)  =   X(LN  +  M) 


U2 


APPENDIX  B        EXAMPLE  USING  REITER'S  DISCRETE  OPTIMIZING  METHOD 


We  seek  the  optimal,  list  of  projects 

for  the 

following 

/3 

0 

2 

-1' 

^  0 

2 

1 

0 

B.1                                   B  =              0 

0 

-1 

■11 

\o 

0 

0 

Let  the  (randomly  or  othervd.se  selected)  starting  in-list  a  =  ^1, 3, ^  ;  i.e.,  we 
begin  with  a  list  consisting  of  projects  1,  3  and  h*     Crossing  out  row  2  and 
column  2,  we  add  the  payoff  elements  not  crossed  out:   3+2+(-l)+(-l)+(-3)+U  =  k. 
Therefore  the  payoff  corresponding  to  this  in-list  a  is  a  -  k.     In  the  table 
we  give  the  payoffs  and  gradients  G.,,  =  rvf  -  Cv  ^°^  ^^  in-list  a'  "connected" 
to  a  —  lists  which  differ  in  only  a  single  project  index. 


a* 

la' 

°a' 

1,3 

k 

0 

lA 

6 

2 

'  3A 

0 

'         -k 

1,2,3, 

k 

7 

3 

The  largest  improvement  resiilting  from  dropping  one  project  or  adding  one  to  the 
in-list  a  =  (l^3>^}  is  3'  which  is  associated  with  a'  «=  J^1,2,3A}  •  This  foms 
the  next  starting  in-list,  which  is  once  again  eveiluated  in  the  table. 


1,2,3      7      0 

■*-  1,2,1^       8        1 

l/S,'*      U      -3 


h3 


Here  the  largest  improvement  is  associated  with  the  move  to  a'  =  [l,2, U>  ,  yielding 
a  total  payoff  of  8t  It  may  "be  seen  to  be  a  local  maximum  from  the  next  table, 
which  takes  this  in- list  as  the  starting  point.  Only  negative  values  for  G  , 
result. 


a' 

1  a' 

^a' 

1/2 

5 

-3 

l,h 

6 

-2 

1,2, 3,k 

7 

-1 

The  local  optimal  list  a  =  {l,2, 1^   turns  out  to  be  the  global  optimum.  The 
tree- structure  of  this  example  is 


(1,2,4) 
(1,2)       (1,1^)       (2,1.) 

(1)  ik)        (2)   (1,3A) 

I 


(1,3) 


(1,2,3) 


(2,3) 


(3) 


The  other  local  optimum  consists  of  projects  1,2,3  vrith  a  payoff  of  J,     Since 
the  15  lists  are  divided  into  two  groups  of  11  on  the  tree  of  the  global  optimum 
list  and  k   on  the  local  non- global  optimum  list,  the  prior  adds  that  a  random 
sample  leads  to  the  global  optimum  here  are  -jp  =  'TS.  For  further  discussion  see  [26] 
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